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Xy^ , Abstract 



Random dynamical systems with countably many maps which admit count- 
ry able Markov partitions on complete metric spaces such that the resulting 

Markov systems are uniformly continuous and contractive are considered. 
A non-degeneracy and a consistency conditions for such systems, which 
admit some proper Markov partitions of connected spaces, are introduced, 
and further sufficient conditions for them are provided. It is shown that 

(-y-> ■ every uniformly continuous Markov system associated with a continuous 

^. | random dynamical system is consistent if it has a dominating Markov 

f"\] ■ chain. A necessary and sufficient condition for the existence of an in- 

(f) ' variant Borel probability measure for such a non-degenerate system with 

a dominating Markov chain and a finite ()14[) is given. The condition 

^^D ■ is also sufficient if the non-degeneracy is weakened with the consistency 

condition. A further sufficient condition for the existence of an invariant 

C~} , measure for such a consistent system which involves only the properties 

£SJ ■ of the dominating Markov chain is provided. In particular, it implies that 

every such a consistent system with a finite Markov partition and a finite 
(|14|) has an invariant Borel probability measure. A bijective map between 
these measures and equilibrium states associated with such a system is 

j^ | established in the non-degenerate case. Some properties of the map and 

<-h ■ the measures are given. 
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1 Introduction 



The purpose of this note is to show the existence of invariant measures for some 
random dynamical systems introduced in [13] as contractive Markov systems. 
To avoid some confusion, let us stress that the word 'Markov' in the name was 
used to indicate a Markovian topological structure of the random dynamical sys- 
tem, which naturally generalizes a weighted directed graph, but the dependence 
structure of random processes which can be generated by it on a code space, 
in contrast to directed graphs, can be far beyond Markovian. They certainly 
can generate any stationary process with values in a discrete state space. At 
the same time, the algorithm for generating a process by such a system is not 
much different to that for generating a process by a weighted directed graph. 
Such random dynamical systems find more and more applications in modern sci- 
ences, e.g. [jj], [I], [I], and provide new challenging and illuminating examples 
for mathematical theories, e.g. [15], [16], [17]. However, in contrast to weighted 
directed graphs, the behaviour of contractive Markov systems is still not fully 
understood. 

The existence of stationary states for such systems was shown on some locally 
compact spaces in |13| . This was proved under the condition that the parti- 
tion of the Markov system consists of open sets. Though, this was sufficient 
to cover finite Markov chains and g-measures [7j with the theory, it clearly 
poses a severe restriction on the applicability of it. In particular, the removal 
of the condition admits the usage of Markov partitions for random dynamical 
systems, which reduce the latter to Markov systems, the behaviour of which is 
more transparent [18| . The proof which was given in [13] went along the lines 
of that which had been given by M. Barnsley et al. for iterated function sys- 
tems with place- dependent probabilities [2]. The result then was extended by K. 
Horbacz and T. Szarek [3] on Polish spaces, through application of some results 
which had been obtained by the second author for Markov operators satisfying 
some non-expansiveness and concentration conditions on Polish spaces, using a 



lower bound technique [TO]. Unfortunately, the condition of the openness of the 
partition has been left in place. 

In this article, we close the gap by introducing a non- degeneracy and a con- 
sistency conditions and providing further sufficient conditions for them. These 
conditions admit some proper Markov partitions of connected spaces and allow 
us to prove the existence of invariant measures for the random dynamical sys- 
tems which exhibit the continuity and the contraction on average properties only 
on the atoms of their Markov partitions. In particular, the consistency condi- 
tion includes all uniformly continuous Markov systems which are obtained from 
random dynamical systems with continuous maps and probability functions and 
have a dominating Markov chain. 

The presented proof is self-contained, does not require any special knowledge and 
works for countable Markov systems. Moreover, it is shown that the separability 
of the space is not needed in this case. The existence of the invariant measures 
is deduced from the existence of equilibrium states on the code space associated 
with such a system, via a coding map. This method is easier because the code 
space is either a compact metrizable space, as in the case with finitely many 
maps, or can be easily extended to such a space in the case of countably many 
maps. This allows to take advantage of the weak-star compactness of the set of 
all Borel probability measures on it. 

The existence of the equilibrium states for energy functions associated with 
such systems has been already shown in [TS] , but it has been deduced from the 
existence of the invariant measures for such systems with the open partition 
on locally compact spaces. The main message of |15| was that the current 
thermodynamic formalism is not applicable to such systems because it fails 
even to predict the existence of equilibrium states for such energy functions, 
not to mention the construction of them. 

Recently, a construction of such equilibrium states has been proposed in |16) 
and |17| . It requires the existence of an equilibrium state for such a system for 
the proof that the constructed measure is not zero. 

An other related existence result is a recent proof in the particular case of 
g- measures by A. Johansson et al. [6J. However, it does not intersect much 
with the present result as the ^-functions associated with our systems are not 
continuous, even in the case of the openness of the Markov partition (see |15| ) 
or the case of contractive maps on a compact metric space, but without the 
openness condition on the Markov partition (e.g. see Example [6] below). 

The present result also establishes a bijection between the equilibrium states and 
the invariant Borel probability measures of such systems in the non-degenerate 
case. In particular, this generalizes a theorem by F. Ledrappier [5], Theorem 
2.1 in PI]. 

The article is organized as follows. Section I collects all the necessary definitions 
and notations. Section 2 presents the main results. Finally, Section 3 provides, 



in particular, some simple examples to which the technique of Markov partitions 
can be applied. As far as the author is aware, some of the examples have not 
been accessible by the theory before. 



2 Definitions and notation 



Let B(X) denote Borel c-algebra on a topological space X and P(X) denote 
the set of all Borel probability measures on it. Let C B (X) denote the set of all 
real-valued non-negative Borel measurable functions on X . For B G B(X), let 
P(B) denote the set of all v G P(X) such that v{B) = 1. 

Let (K,d) be a complete metric space. A family Dr := (K,w e ,p e ) e< £E is called 
a random dynamical system on K iff E is at most countable, w e : K — > K and 
p e : K — > [0, 1] are Borel-measurable for all e € E such that ^2 e£ EPe( x ) = 1 
for all x G K. w e 's are called maps and p e 's are called probability functions. 

With Dr is associated a Markov operator U defined on C B (K) by 

Uf := y^Pefow e 

eEE 

for all / G C B (K). Let U* denote its adjoint operator acting on v G P(K) 
by U*v(f) := fUfdv for all bounded / e £ B (i^). /u G P(i^) is called an 
invariant measure for the random dynamical system iff U*fj, = /i. Observe 
that, for the definitions of U and [/*, each w e needs to be defined only on set 
{x G K\ p e (x) > 0}, it then can be extended on the whole space arbitrarily. 

A random dynamical system is called a Markov system iff it has the form 
(K i r e \,w e ,p e ) e £E> where E' is a set such that there exists a partition of K 
into non-empty Borel subsets (Kj)j^n, N C N with leiV (case where the size 
of N is f is not excluded), and a surjective map i : E' — > N and t : E' — > N 
such that for every e € E' there exist Borel measurable w e : Ku e \ — > -^t(e) 
and p e : ii*j( e ) — > [0, f] such that there exists x e G -£Q( e ) with p e (x e ) > 0, and 

See_E' i(e)=i P £ (y) = ^ ^ or a ^ V ^ ^3 anc ^ J ^ -^- ^j' s are ca ll e d the vertex sets 
of the Markov system. The Markov system is called countable iff N and E are 
at most countable. Clearly, a countable Markov system defines a random dy- 
namical system on K by extending p e 's on K by zero and i« e 's arbitrarily. Such 
extensions define the actions of the Markov system on functions and measures 
through operators U and U* and will be always assumed. 

We say that a random dynamical system has a Markov partition iff there exists 
a partition of K into non-empty Borel subsets such that the restrictions of its 
maps and probability functions on the atoms of the partition (after a possible 
re-indexation) form a Markov system. 

A Markov system (K i r e \,w e ,p e ) e£ E is called contractive with a contraction rate 



< a < 1 iff 

y p e (x)d(w e x,w e y) < ad(x,y) for all x, y G Kj and j G TV. (1) 

We say that a Markov system {K i ^,w e ,p e ) e £E is (uniformly) continuous iff 
maps (w e |x i((!) )ee_E and probability functions (p e |Ar i(e) )ee_E are (uniformly) con- 
tinuous, where notation f\ A means the restriction of a function / on a set A. 

A sequence (ei, ..., e„) oi ei G E for all 1 < i < n is called a path of the Markov 
system iff i(ei + i) = t(ei) for all i. We will denote by S x G P (K) the Dirac 
probability measure concentrated at x G if, by B a (x) the closed ball of radius 
a and centre x, by 1,4 the indicator function of a set A, by A the topological 
closure of a set A and by / the continuous extension of a uniformly continuous 
function / on the closure of the domain of its definition. For a measurable map 
between measure spaces / : (X, A, n) — > (Y,B), /(/«) will denote the measure 
on (Y,B) given by f{p){B) := ^(/"^B)) for all BeR and / _1 (B) will denote 
the cr-algebra {f~ 1 (B)\ B G B}. As usual, <C will denote the absolute continuity 
relation for measures. 

Let (X, B,A) be a probability space and I be an at most countable set. A 
family (Ai) ie j C B is called a partition of (X, Z?, A) iff its members are pairwise 
disjoint and A(X \ \J ieI Ai) = 0. For a partition a of (X, B, A) and a sub-c- 
algebra C <Z B, H\(a\C) will denote the conditional entropy of a conditioned on 
C with respect to A, which is given by 

F A (a|C) :=-J2 E A (l A \C)\ogE A (l A \C), 

Aea 

with the usual definition OlogO := 0, where E\(1a\C) denotes the conditional 
expectation of indicator function 1a conditioned on C with respect to A. 



3 Results 

Let Dr be a random dynamical system on a complete metric space (K, d) which 
has a Markov partition (Kj)j £ n such that the resulting Markov system Ai := 
(.Kj( e ), w e ,p e ) el zE is countable. Set 

P(M) := {n eP(K)\U* » = »}. 

Let E and N be provided with the discrete topologies. Set E := E U {oo} en- 
dowed with Alexandrov's one-point compactification topology, i.e. the topology 
consists of all subsets of E and sets of the form E\C where C C E is finite. 
Note that the topology has a countable base (the axiom of choice is assumed in 
this paper). Let E be equipped with the Borel cr-algebra. Note that the Borel 
cr-algebra still consist of all subsets. We can write Dr = (K,w e ,p e ) eGE where 



Woo := id and p^ := 0, as such an extension does not change the action of 
Dr on functions and measures by its operators. Set i(po) := 1 and i(oo) := 1. 
Then we also can write M. = (K i r e \,w e ,p e ) ee g ; in the above sense. Now, set 
£ := {a := (..., <7_i, Co, ci, ...)| <Ti G P for all i G Z} provided with the product 
topology. Hence £ is Hausdorff and, by Tikhonov Theorem, compact. More- 
over, the topology of E has a countable base, since E does, and it is regular, 
since E is, and therefore, it is metrizable, by Urysohn's Metrization Theorem. 
E is called the code space of the Markov system. Note that, since the topology 
of E has a countable base, the Borel cr-algebra on E coincides with the product 
cr-algebra. Let S : E — > E be the left shift map given by (Sa)i-i = oi for 
all i € Z and a € E. Let Ps(E) denote the space of all shift invariant Borel 
probability measures on E equipped with the weak-start topology. Recall that, 
since E has a countable base, the Banach space of all continuous functions on 
it is separable, and therefore, the weak-star topology on the unit ball of the 
dual space is metrizable. Furthermore, by Riesz Representation Theorem and 
Alaoglu Theorem, Pg(E) is compact and metrizable in the weak-star topology, 
as a closed subset of the unit ball. 

Let 77i < n G Z and e m ,...,e n G E. Set m [e m ,...,e„] := {cr G £| <7, = 
e; for all m < i < n\, it is called a cylinder set. Let _4 m denote the cr-algebra 
generated by cylinder sets of the form m [e m , ..., e„], n > to, and J" TO C ^4. TO , m < 
0, denote the cr-algebra generated by the cylinder sets of the form m [e m , ..., eo]. 
Let E denote the u-algebra generated by U m < ^ m - 

For x £ K, let P™ denote the probability measure on A m given by 

PT( m [e m ,...,e„]) :=p em (x)p em+1 (w em x)...p en (w en _ 1 o ... o w Cm x) 

for all m [e m ,...,e„] G ^4 m , n > m, e.g. by Kolmogorov Consistency Theorem. 
Observe that P™ = P° o S"™ for all to < 0, x G K (here, 5 m denotes the 
naturally induced set map). 

Let E + := {(ci, cr 2 , ...)| ctj G E for all i€N} provided with the product topol- 
ogy and the product cr-algebra, and let B(K) <g) 2?(E + ) denote the product cr- 
algebra of the Borel cr-algebra on K and that on E + . Let m [e m , ..., e„] + C E + , 
m > 0, denote a cylinder set. For x G K, let P x denote the Borel probability 
measure on E + given by 

P x (i[ei, ...,e„]) := p ei (x)p e2 (w ei x)...p en (w en _ 1 o ... o w ei x) 

for all i[ei, ..., e„] C E + . 

Set 

Eg : — {^ <= E| i(cr„ +1 ) = i(cr n ), <j n E E for all n G Z} 

provided with the metric d'(a,a') := 2~ k where k G N n is the largest with 
o~i = a\ for all |i| < k. Observe that the topology on Eg which is induced from 
E coincides with that given by d' . 



Remark 1 In the following, often implicitly, the following fact will be used, 
which might be useful to observe before. For every m [e m , ...,e n ] £ A m , % £ 
K and m £ Z, P" l ( m [e m , ..., e„]) > implies that (e m ,...,e„) is a path of 
the Markov system and x £ ifj( em ). This follows from the definition that the 
probability functions are zero outside their vertex sets. Note that, in this paper, 
they are allowed to be zero also on their vertex sets, whereas in [13J it was 
required that p e \K i{e) > for all e £ E. The latter is necessary if one wants to 
prove that the process started at any x £ Ki, for a fixed i £ N, converges to 
the same stationary state |18| . However, in this article, we are concerned only 
with the question on the existence of the stationary states. 

Moreover, observe that, since i is surjective, 

Y, P™- k { m [e m ,...,e n ]) = l (2) 

(e m ,...,e„) is a path 

for all x £ K, m < n and k > 0. 



3.1 Equilibrium states 

Now, fix Xi € Ki for all i £ N, and set 

lim w ao o ... o w am (xi( cr )) exists 

m— > — oo 




lim w ao o w a _ x o ... o w am (x i ( (Tm )) ii a £ D 



in— ¥ — oo 



X t(<T ) 



otherwise. 



for all a £ S. F : S — >• K is called the coding map of the Markov system. 
Clearly, it is .F-Borel-measurable. Furthermore, let F : Ps(S) — > P{K) be 
given by F(A)(B) := A(F- 1 (B)) for all Borel B C if and A £ P S (S). 

Next, set 

S(M) := {Ae P s (2)| A(D) = 1 aiid.E A (l l[e] |.F) = p e o F A-a.e. for all e e E) 

It will be show in Subsection l3. 1 . ll that the definition of E(M) naturally extends 
the notion of equilibrium states in the thermodynamic sense. 

3.1.1 Thermodynamic equilibrium states 

Now, we are going to show that the members of E(A4) with finite entropy 
which can be computed according to Kolmogorov-Sinai Theorem are exactly 



the equilibrium states in the thermodynamic sense, which minimise the free 
energy of the system, for the following energy function. Set 



u{a) 



logjVj o F{a) iiaeD 

— oo otherwise 



for all a G E with the definition log(O) := — oo. u is called the energy function 
of the Markov system. 

Definition 1 For A G Ps(£), set 

MA):=fiA((i[e]) eeS |^. (3) 

Recall that, by Kolmogorov-Sinai Theorem, /15(A) is Shannon-Kolmogorov- 
Sinai entropy if — X^ees A dH) l°gA (i[e]) < 00. A G Ps{^) is said to be 
an equilibrium state for u iff hg(A ) < 00 and 



MA)) + / udA = sup < /is (A) + / udA ^ . 

J AeP s (S), /i s (A)<oo I J J 

Let E(u) C -Ps(E) denote the set of all equilibrium states for u. 

The proof of the next lemma is an adaptation of Ledrappier's proof [8J. 

Lemma 1 Let A G Ps(S) suc/i i/iai /is (A) < 00. TTien 

/is(A)+ fudA<0, (4) 

and i/ie equality holds if and only if A G -E(.M). 

Proof. Let's abbreviate 

5e :=-EA(l 1 [e]|J') 

for all e <E E. If / udA = -00, then /15(A) + JudA = -00 < and (gj) holds 
true. Otherwise, A(£>) = 1, and therefore, since J, „, l 1 r e i logp e o .FdA = 
for all e G E, 

/15(A) + / udA = ~^2 9e log.o e dA + ^2 1 iW lo SPe ° MA 
= Yl / ^elog- 2 dA 

= S / (Pe°F-g e )dA 

= 0. (5) 



Thus ((3]) holds true in this case also. If (Q| is an equality, then J udA > — oo, 
and therefore, A(D) — 1 and, by (0, 

Hence 

log ; ; = ; - 1 for A-a.e. a G { 5e > 0} 

for all e € -E, but this is possible if and only if 

g e {v) — Pe° F(a) for A-a.e. a G {g e > 0} 
for all e E E. Therefore, 

E A (l l[e] \F) <p e oF A-a.e. 
for all e € E. However, as then 

1 = E / ^ A ( X i M I ^) dA<Y J fpeoFdA = l, 

e£E e£E 

it follows that 

£ A (Iilejl-T 7 ) =Pe°F A-a.e. 

for all e£JJ. Thus A € £(M). 

Conversely, if A G E(M), then, as A(i[oo]) = 0, 

&s(A) = -53 f E A (l l[e] \T)logE A (l l[e] \T)dA 

eeE'' 

= -EE / £ A (l l[e] |.F)log£ A (l l[e] |J-)dA 

- {n-l<logE A (l lle] \F)<n} 

= -EE / l l[e] lo gj B A (l l[e] |J-)dA 

- {n-l<lo S E A (l l[e] \F)<n} 

E / logp e oFdA 



i[e] 



wdA. 



That is 

/i s (A) + / udA = 0. 

This completes the proof. D 



Theorem 1 If {M G E(M)\ h s (M) < 00} is not empty, then {M G E(M)\ h s (M) < 
00} = E{u). 

Proof. By Lemma [TJ every member of {M G E(Ai)\ hs(M) < 00} is an 
equilibrium state of u. Conversly, for every Ao G E(u), by the hypothesis and 
Lemma [TJ 

^Ao (S) + / udA Q = 0. 

Thus, by Lemma [TJ A G E{M). This completes the proof. □ 

Theorem [TJ and Example [5] from Section [T] seem to indicate that Shannon- 
Kolmogorov-Sinai entropy might be not the best choice of the entropy for a 
satisfactory thermodynamic description of such systems. 

3.2 Uniformly continuous Markov system 

In this subsection, we develop a general theory on the relation of the equilibrium 
states and the invariant measures of M. if it is uniformly continuous. 

Proposition 1 Suppose W e \K iM is uniformly continuous for all e G E. Then 
F(M) G P(M) for all M G E(M). 

Proof. Let M € E(Ai). Let w e denote the continuous extension of w e \x iM on 
the closure of K,^ for all e G E. Observe that, as M(D) = 1, 

w ai o F{a) =Fo S{a) for Af-a.a. a G S. (6) 

Let / G C B (K) be bounded. Then, by the shift invariance of M, 

j fdU*F(M) = fj2Pef° w e dF(M) = fj2Pef°We dF(M) 

= ^2pe°Ffow e oFdM^^2 l l[e]f OW e oF dM 

** eG_E egE"' 

= 5Z [f°F°SdM= ffdF(M). 

Since / was arbitrary, this completes the proof. □ 

Now, for jU G -P(A^), set 

4>m(n)(A) := J P™(A)du(x) 

for all A G -4 TO and to < 0. Observe that, by the invariance of /1, m (^)'s are 
consistent for all to < (e.g. see [16J). Let $(/i) G Ps(E) denote the measure 

10 



which uniquely extends m (/i)'s on the Borel cr-algebra, e.g. by Kolmogorov 
Consistency Theorem. This defines a map $ : P(A4) — > Pg(S). 

It is not difficult to check that, for every v £ P(K) and Q £ B(K) <g> B(§+), 

0(i/)(fi) := I P x ({a€Z + \ (x,a)en})dv(x) 
defines a probability measure on B(K) <E> S(E + ) such that 
fd$(y)= f f f(x,a)dP x (a)dis(x) 



for every 0(i/)-integrable function / : K X S + — >• [—00, +00]. 
Set 

7T : S — ► £ + 

(...,O-_l,o- ,CTi,...) 1 — ► (cri,cr 2 — ) 

and 

77 : £ — > K x £+ 

a ^(F(a),^(a)). 

Lemma 2 Suppose w e \x iM is uniformly continuous for all e £ E. Let M £ 

E{M). 

(i) ®(F(M)) = M. 

(ii)r,{M) = 4>{F{M)). 

(Hi) Let f e : K — > [—00, +00] be Borel measurable for all e £ E such that 

J2eeE 1 i[e]\fe\ ° F £ C 1 {M) . Then there exists g £ C 1 {(j){F (M))) such that 

f gdj>(F(M)) =J2eeE f PefedF(M) and 



1 " 

_ J] Uk+i ° w *k ° ••• ° w °i 0) -> 9(x, a) 

n * — » 



n 

fc=i 



/or iVa.e. a £ £+ and m £ 1 (0(F(M))) for F(M)-a.e. x£K. 
(iv) For F(M)-a.e Xo £ K , the sequence of probability measures (a„) Tl gN on N 
given by o: n ({j}) := 1/n 5Zfc=i ^* ^0 (Kj) f or a ^ 3 ^ N and n £ N converges 
in total variation. 



Proof, (i) Let i[ei, ...,e n ] C £ with (ei, ...,e„) G -E. One easily checks that, by 
the shift-invariance of M and (O, 

^M(l l[ei ,..., e „]|^")(CT)=^ (CT) (i[ei,...,e„]) for M-a.e. a £ E. (7) 

11 



Therefore, 

$(F(M))(x[ei,...,e„]) - / P\ ( x \e u ...,e n ])dF(M) 



P 1 F{l7) { 1 [e 1 ,...,e n ])dM{a) 

= M( 1 [e 1 ,...,e n }). 

Thus, by the shift-invariants of the measures, they agree on the class of cylinder 
sets of the form m [e m , ...,ei m i], to < 0, where e m , ..., e\ m \ G E. If a = oo 
for some m < i < \m\, then $(F(M))( m [e m , ..., ei m i]) = by the definition, 
and M( m [e m , ...,ei m i]) = 0, as M(£ \ D) = 0. Thus, the measures agree on 
the Borel cr-algebra, as the class of cylinder sets of the form m [e m , ..., ei m i], 
e m ,...,ei m i € B, to < 0, plus empty set, generates the product cr-algebra, is 
H-stable and, obviously, Uee-E°N = ^- 

(ii) We only need to check that 

T)(M)(Ax 1 [ei,...,e n ]+)=j>(F(M))(Ax 1 [e 1) ...,e„] + ) (8) 

for all cylinder sets i[ei, ..., e n ] + C S + and Borel A c K. For such sets, 
r)(M)(Ax 1 [e 1 ,...,e„]+) = M^" 1 ^)!"! i[e 1; ...,e„]) 

l 1 [e 1 ,...,e„]rf^, 



F-i(A) 

where i[ei, ...,e n ] C £ is the pre-image of i[ei, ...,e n ] + under tt. Clearly, both 
sides of © are zero if e, = oo for some 1 < i < n. Now, let ei,...,e„ G -E. 
Then, by ©, 

/ l 1 [e Il ...,e„]<^ = / PF(<r)(l[ei,...,e n ]+)rfM(cr) 

F- 1 (A) F-!(A) 

P x (i[e 1 ,...,e B ]+)dF(A0(a;), 

A 

as desired. 

(iii) Set /oo := and u(ct) := f ai (F(<r)) for all a E S. Then, 

/"|v|dM = /"^l l[e] |/ e |oFdM<oo. 

^ ^ eSF 

Hence, u G £ X (M). Let X be the cr-algebra of all shift-invariant Borel subsets 
of S. Set v := B M (v|I). Then, by Birkhoff's Ergodic Theorem, 

1 ™ 

_ 5Z u ° S ' fe -*• " M-a.e. and in £ X (M). 



n 
fc=l 



12 



Since M(D) = 1 and F o S k (a) = w ak o ... o w ai o F(o-) for all ct G D and fc G N, 

1 - 

— \J / CTfc+ i ° w CTfc o ... o u} CTl o F(a) — > u(er) M-a.e. cr € S and in C X {M). 

fc=i 

Set 

1 " 
f n {x,a) := - V/<r fc+1 ow CTfc o...ow (x) 
n *■ — ' 

for all a; G if, cr G £ + and n G N. Then 

/n ° f/(o") -> v(o-) M-a.e. cr G S and in C l {M). 

Hence, v is r]^ 1 (B(K) eg) £>(£ + ))-measurable. Therefore, by the Factorisation 
Lemma, there exists a B(K) <g) S(S + )-measurable function 5 such that 

^ — 5 ° 7 7- 
Then, by (ii) and the definition of <j>(F(M)), 

f n (x,a) — > g(x,a) for F(M)-&.e. x G K and P x -&.e. a G S + 
and in C x ((f>{F(M))), and 

/ gd<t>(F(M)) = /go jjdM = / wdM = J^ / p e oFf e o FdM 

J J J e£E^ 

= J2 fpefedF(M). 

This completes the proof of (iii), as P x {{cr G S + | x ^ ^i(o-i) or 3fc G N s.t. 
i(cr fc+ i) 7^ i(o-fc)}) = 0, by RemarkQ] 

(iv) By Proposition [Q fi := F(M) G P(M). Let i G N. Set ^ := {e G 
E\ i(e) = i} and f e = lx { for all eefi; and / e = for all e G 22 \ 2%. Then, by 
(iii), there exists gi G /C 1 (</>(//)) such that 

/ 9id4>(^) =^2 Veh&V = K K t) ( 9 ) 

and 

1 - 

— \^fa k+1 w (Jk o...ow ai {x)^gi(x,a) for P^-a.e. cr G S + and /j-a.e. x £ K. 

fc=i 

One readily checks that J /<7 fc+1 ° w CT)! o ... o w ai (x)dP x (a) = 17*(ljf 4 )(a;) for all 
x E K. Hence, by Lebesque's Dominated Convergence Theorem, 

1 - f 

- > ^(IkAUc) -> gi(x,a)dP x (a) for u-a.e. x G if 

n z — ' / 



fc=i 
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for all i € N. As N is countable, also for /i-a.e. x E K, 

1 - r 

-^2u k (l Kz )(x) -> / g t (x,a)dP x (a) for all i G A. 



fe=i 
Hence, by Fatou Lemma, 



- , n 

V gi(x,a)dP x {a) = V liminf - V C/ fe (l K J(x) 

i£N J i£N fc=l 

1 " 

< liminfV- 'yU k (l Ki )(x) 

n— voo -^ — ' 7| ■*- — ' 
iGW fc=l 

= 1 for /i-a.e. x E K. 

Since, by ©, JJ2ieN 1 9i(x,a)dP x (cr)d^(x) = J2ieN v( K i) = *> tnere exists a 
Borel H C K with /i(-ff) = 1 such that for every xo G -ff, 

lim a„({j}) = a({j}) for all j G A 

where a is the probability measure on A given by a({j}) := J g^ (xo, o~)dP Xo (a) 
for all j € A. Let x G ff. Choose a finite V c G A such that a(K) > 1 - e/3. 
Then there exist 5 G N such that a n (V e ) > 1— e/3 for all n > S and finite ViCJV 
such that ai (Vi) > 1 - e/3 for aU 1 < i < S. Set V/ := 7 e U (jf^ 1 K- Then 
an(V r e ') > 1 — e/3 for all n E N. Now, choose no G N such that Yljev \ a n({j}) ~ 
a({j})\ < e/4 for all n > n . Let A C A. Then 

\a n (A)-a(A)\ < \a n (An V?) - a(An F £ ')| +a n (A\ V?) + a(N\ V£) 

e 2e 
for all n > n . Thus sup j4cAr |cCn.(A) — a(^4)| < e for all n > Hq. □ 



3.2.1 The non- degeneracy condition 

Definition 2 Set Tj := {a G S G | *(o"o) = j} for a U J G A. Then, obviously, 
Tj n Tj/ = for all j ^ j' and [Jj eN Tj = Hq. Suppose p e \ic iM is uniformly 
continuous for all e G E. For each e £ E, let p e denote the continuous extension 
of p e \K i{c) on -K"i( e ) which is extended further on K by zero. Let E(M.) denote 
the set 

{A G Ps(E)| A(D) = 1 and ^(l^jlJ") = p e o Fl Tl{c) A-a.e. for all eeB}. 

We call M. non- degenerate if and only if for every A G E{M) there exists i G A 
such that A(Tj n .F - 1 (.Kj)) > 0. (For example, every uniformly continuous 
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Markov system with an open partition is non-degenerate, as Tj C F l {Kt) for 
all i G N.) Set G := (JfeLo U ie jv 5 , " fe (-F ,_1 (-^i) n T;). Then obviously, .M is 



non-degenerate if and only if M(G) > for all M G £(.A/f). For M G -E(TW), 
set 

M G (B) := J M(G) lf M ( G ) > ° for a u B e B(g). 
| otherwise 

Then, clearly, M G G P S (E) U {0}, as S^G C G. Set dp e := p e ljc i(e) \jc i(e) for 
all e <G -E, and let Ej_(Ai) denote the set 

{A G P s (S) | A(D) = 1 and £ A (l^F) = dp e o Fl T . (e) A-a.e. for all e e E} . 

Lemma 3 (i) Let A G E(M). Then A(G) = 1. 

(ii) Suppose p e \K i(c) is uniformly continuous for all e G E . Then A(G) = for 

all Ae £7_l(.M). * ' 

Proof, (i) Let i G N and AeJ. Then, since A(E G ) = 1, 

A(AnT,)= ^ /l l[e] dA= ^ [ Pe oFdA = A(AnF- 1 (K i )). 

e£-E,i(e)=i ^ e£i£,i(e) = -i * 

Hence, A(T;) = A^" 1 ^)) and A{F- l {Ki) n T 4 ) = A{F- l {Ki)) for all i G TV. 
Therefore, 

A(G) > A { |J F- 1 ^) n T 4 J - ^ A (F-^K,)) = 1. 

View / ieAT 

(ii) Let A G Sj_(A4), i E N and Ae J. First, observe that, by Fatou Lemma, 

eGE,i(e)—i 

Therefore, since A(£ G ) = 1 and T t C F- 1 {K i ), 



A(AnT,)= J2 [p* ° F1 K t \K t ° Fl Ti dA < J 1 



T i \F- 1 (K i )dA. 



Hence A{F- 1 {K l ) n T;) = 0, and therefore, 



A(G)< J2 k(S- k (F- 1 (K l )nT l ))=0. 
ieN,k>a 
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Lemma 4 Suppose Ai is uniformly continuous. Let M G E{M). 

(i) IfM{G) > 0, then M G G E(M). 

(ii) E(M) CE(M). 

(Hi) There exist A e E(M) U and Aj. G Fi(A'f) U swc/l t/iai 

M = M(G)A + (1 - M(G))A ± . 

TTie decomposition is unique if < M(G) < 1. (Then, by Lemma\^ A = M G , 
and A_l is singular to A.) 
(iv) E±(M) CE(M). 

Proof, (i) Clearly, M G < M. Hence, M G (D) = 1. Let e e F. It is a well 
known fact and it can be easily checked that the absolute continuity relation and 
the shift-invariance of the measures imply (the shift-invariance of the Radon- 
Nikodym derivative which in turn implies) that Em {^i[e]\J') = Em g (life] I-? 7 ) 
M G -&.e.. Hence, 

E Mg (l l[e] | J") (a) =p e o F(cr)l Ki(e) (xt(a )) for M G -a.a. a G S. 

Let cr G GflD. Then there exist k > and j G AT such that S k (a) £ F" 1 ^) n 
I}. That is F o S ,fc (cr) G K, and i(cr fc+ i) = i(er fe ) = j. Hence, F o S n (a) = 
uv„ o ... o w CTfe+1 (F o S k (a)) = w an o ... o w ak+1 (F o S k (cr)) for all n > k, and 
therefore, 

PeoFo S»l T , (c) o S» = p e o W(Tn o ... o Wak+1 (F o 5 fc (a)) l* 4(e) (ar t( „ n) ) 

= p e ora ffn o...ow 1TH1 (FoS' ; ((T)) 

= Pe ofoS"((T) 

for all n > fc. Let A G F. Then 

1 - 

-Vfeofo 5*'(ff)lr., , o S'^Ia o S l (cr) - Pe oFo S l (a)l A o SHa)) ->■ 

i— 1 

(10) 
for all cr 6 Gn F. By Birkhoff's Ergodic Theorem, there exist v e ,v e G /^(A/g) 
such that J A p e o Fl Ti(e) dM G = J v e dM G , J A p e o FdM G = / u e dM G , 

-j n 1 n 

— y p e o F o S z 1t ■, , ° S 1 1a ° S l —> v e and — } p e o F o S 1 1a ° S l —> v e 
n *— ' ne ' n ^^ 

i— 1 i— 1 

both M G -a.e.. Hence, since M G (Gn £)) = 1, « e = u e Mg-a.e., and therefore, 
fp e o Fl Tz{c) dM G = f Pe o FdM G . 

A A 

Thus 

E M G (l x [e] I-7 7 ) = Pe o F MG-a.e.. 

16 



This completes the proof of (i) . 

(ii) Let A G E(M). Then, by Lemma||i), A(G D D) = 1. Therefore, by (|TU|) . 
the same way as above, 

/l l[e] dA= P oFdA= / p o Fl T . (e) dA 

for all e G -E and Ae J. Thus A G _E(.M). This completes the proof of (ii). 
(iii) By (i), we can assume that M(G) < 1. Set 

M(i?ns\G) 

A±(B) - M (E \ G) 

for all B € B(£). Then Aj. € Ps(S), since S^G C G, and 

M = M(G)M G + (1 - M(G))A X . 

By (i), M G G E(M). Note that A_l < M. Let ee£. Then, Aj_(D) = 1, and, 
as in the proof of (i) , 

E A± (l^ejl-7 7 ) = p e o Fl Ti(e) A_L-a.e. . 

Let A G T . By Birkhoff's Ergodic Theorem, there exist v e ,dv e G £ 1 (A±) such 
that J v e dA± = f A pe° FlT i , e) dA± and J dv e dA± = J A dp e o FlT i(c) dA± and 

-. n 1 n 

-Vp e ofo S*1 T ., , o S 4 1 A o S* fc -> u e and -V^ofo S 1 ^ o S k -> <% e 
fc=i fc=i 

both Aj_-a.e.. Note that p e = p e + dp e . Therefore, 

Pe°F\ Ti{e) =p e oi ? lj.- 1 ( Jf . w ) nT . w + <9p e o F1 Tjw . 

Let ere DnS\G. Then for each fc G NU{0} and ieN,S k (a) G fi\(F- l (Ki)n 
Tj). Hence, 

p e oFo S k (a)l Ti(e) o S fc (<x) =%°Fo S k (<r)l TiW ° S fc (cr) (11) 

for all fc G N. Therefore, since A^(£> n E \ G) = 1, v e — dv e Ai-a.e.. and 

/ p e o Fl Ti{e) dA ± = / dp e o Fl Ti(e) dA_L. 

A A 

Thus A x G E±(Ai), and the existence of the decomposition is proved. 
Suppose < M(G) < 1, and there exit A' G E(M) and A^ G E±(M) such that 

M = M{G)A' + (1 - M{G))A' X . 
17 



Then, by Lemma Hi), A'(G) = 1. Hence A' X (G) = 0. Therefore, M(B n 
G) = M(G)A'(B) for all B € 6(E). That is A' = M G . Hence, A^ = (M - 
M(G)M G )/(l - M(G)) = Ax- Thus, the decomposition is unique. 

(iv) Let A e E ± (M), e € E and Ae T. Then, by Lemma^ii) , A(DnS\G) = 1. 
Hence, by (fTTj) . the same way as above, 

[l x[e] dA= J d Pe oF\ Tiic) dk= fpoFl T . M dA. 

A A A 

Thus A e E(M). □ 

Theorem 2 Suppose M is uniformly continuous. Then the following are equiv- 
alent. 

(i) M is non- degenerate. 
(ti) M{G) > for all M E E(M). 
(Hi) E±(M) is empty, 
(iv) E(M)=E(M). 
(v) M(G) = 1 for all M e E(M). 

Proof, (i) <=> (ii) is obvious. 

(ii) => (Hi) follows by Lemma E](iv) and Lemma [3] (ii) . 

(iii) => (iv) follows by Lemma 0] (ii) and (iii) . 

(iv) =>■ (v) follows by Lemma |31 (i). 

(v) => (ii) is obvious. □ 

3.2.2 A sufficient condition for the non-degeneracy 

The following lemma will be used to show the non-degeneracy of most of the 
examples in this article. 

Definition 3 Suppose M. is uniformly continuous. Set 

Rf := ^2 d Pef ° *e 

e<EE 

for all Borel- measurable / : K — > [0, +oo], and 

n = p| {R n i > i}. 

Clearly, if the partition of M. consists of open sets, then Rl = 0, and therefore 
D, = 0. Note that, by Fatou Lemma, 

Rl = J2 d Pe = E E PelRAK, < Z li?A^ ■ 

eeE jeN eeE,i(e)=j jeN 
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Therefore, C \J jeN K j \ K 3 . 

Lemma 5 Suppose A4 is uniformly continuous. Let A £ E±(M.). Then 

F(A)(n) = i. 

Proof. Let n £ N. Using the shift-invariance of A and ©, one easily checks 
that, for all e\, ..., e n G F, 

Ek (l 1 [ ei ,..., e „]|-7 r ) 

= ljf i(ea ) ( a; t(ei))--- 1 K i( e„) ( x t(e n -i)) 

xdp ei o Fl TiUi) dp e2 o w ei o F...dp £n o w €n _ 1 o ... o u) ei o F A-a.e.. 
Therefore, for every B £ B(K), 

F(A)(B) = J2 J 1 i[-i,-,e»]dA. < y (iTl)oFdA 

i? n ldF(A). 

That is 1 < R"l F(A)-a.e.. The assertion follows. D 

Lemma 6 Suppose Ai is uniformly continuous. Then M is non- degenerate if 
F _1 ($7) is empty. 

Proof. The assertion follows immediately from Lemma [3] and Theorem [5J □ 

3.2.3 The consistency condition 

Example 0] (below) shows that the non-degeneracy is not a necessary condition 
for the existences of an invariant measure for a finite uniformly continuous con- 
tractive Markov system. The following theorem can be used in the degenerate 
case. 

Definition 4 Suppose A4 is uniformly continuous. We call M. consistent if and 
only if F(M) £ P{M) for all M £ E(M). By Theorem [S] and Proposition Q] 
every uniformly continuous non-degenerate Markov system is consistent. 

Condition 1 Ai is uniformly continuous and 

(Rf) o F(a) < {Uf) o F{&) for all a £ F" 1 ^) 
and all bounded f £ C B (K). 
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Obviously, the condition is satisfied if -F -1 (0) is empty, which, by Lemma [SI 
implies the non-degeneracy. In general, it implies the consistency, as the next 
theorem shows. However, it is not a necessary condition for it (see Example 2]). 

Theorem 3 (i) A4 is consistent if and only if F(A) G P(A4) for all A G 

E ± (M). 

(ii) M. is consistent if it satisfies Condition [IJ 

Proof, (i) The 'only if part follows by Lemma 3] (iv). For 'if part, let M G 
E{M) and A G E ± (M) such that M = M{G)M G + (1 - M(G))A, by Lemma 
H(iii). Then F(M) = M(G)F(M G ) + (1 - M(G))F(A). Hence, by LemmaEUi) 
and Proposition [D F(A) € P(M). 

(ii) Let A <G E±(M) and / G C B (K) be bounded. Then, by the hypothesis and 
Lemma [SJ 

f fdF(A) =J2[ W ° Fdk = J2 f K[e]f ° w e o FdA 
= J2 [ d Pe ° F1 ^m fow e oFdA< f(Rf) oFdA< I UfdF(A). 

Hence 

r fdF(A)< [ fdU*(F(A)) 



Since / was arbitrary, it follows that F(A) G P(M). □ 

Lemma 7 Suppose T>r is continuous, and M. is uniformly continuous, 
(i) Let f G C B (K) be bounded. Then 



Vie AT / 



Uf. 



(ii) M. is consistent if^2 ieN ^Ki\Ki(E(cr)) < 1 for all a G F 1 (0). 

Proof, (i) Let Vr = (K,w' e ,p' e ) e& E' with w' e : K — > K and p' e : K — > 
[0, 1] both uniformly continuous for all e G E' and c : E — > E' be given by 

w 'c(e)\ K i(.e) = w ekj (e ) and i»c( e )kj ( e) = w el%) for an e € E. Note that, for 
each j £ N, 

5Z 5Z Pef °w e <Uf. 

e eE,i(e )=j efEc- 1 ({c(e )}) 

Furthermore, by the continuity of X>/j, for each eo G £, 

5p eo = Pe lK Heo) \K Keo) = 1 K Keo) \K iieo) P' c (e ) 

= 1 K iieo) \K i(eo) Yl Pe 1 ^.)' 

eec -i({c(e )}) 
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andw eo |K i(e) nK i(eo) = w l(e )lx j(e) nK i(eo) = w e | Ki(c)ni?i((!o) for all e £ c 1 ({c(e )}). 
Therefore. 



Rf = J2 d P*of' 



eoEE 

= S H ^A** E Pel^ (c) /ow eo 

j£Ne £E,i(e )=j etc' 1 ({c(e )» 

jew 
This completes the proof of (i) . 
(ii) The assertion follows immediately from (i) and the hypothesis. □ 

3.2.4 The dominating Markov chain 

Definition 5 We say that M. has a dominating Markov chain iff there exits 
< £ < oo such that 



^2 SU P Pe(x) < £ for all i £ N. (12) 

e£ 

In this case, set 



e£EMe)—i 



J2 SUp p e {x) 

eeE,i(e)=i,t(e)=j xeKi 

l ° ' E SU P Pe{x) 

e£E,i(e)=ix£Ki 

for all for all i, j £ N and 

c := Y] supgy. (13) 

Lemma 8 Suppose M. has a dominating Markov chain and each p e \K i(c) is 
uniformly continuous. Let j £ N . Then 

y Pe{%) = Ik ( x ) f or a M X £ K. 

e£E,i(e)—j 

Proof. Let x £ K. If x £ Kj , then, clearly, Eee-E i(e)=i -Pe( x ) = 0- Oth- 
erwise, there exists a sequence (x„)„ e pj C Kj such that lim„_ 5 . 00 x n = x. 
Clearly, E ee ,E, 4 (e)=.j Pe( x «) = T, e eE,i(e)=jPe( x n) = l fo r all n £ N. Since 
lim Il _ 5 . 00 p e (x n ) = p e (x) for all e € E with i(e) = j, and M. has a dominating 
Markov chain, it follows, by Lebesgue's Dominated Convergence Theorem, that 

Ep e (x) = lim y^ p e (x„) = 1. 
n— >-oo fc * 

eGE,i(e)—j e€;E,i(e)—j 
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Thus, combining both cases, J2eeE,i(e)=jPe( x ) = ^Kji x )- D 

Theorem 4 Suppose T>r is continuous, and Ai is uniformly continuous and 
has a dominating Markov chain. Then A4 is consistent. 

Proof. Let Ae E±(M) and f £ £ s (iT) be bounded. Let V R = (K, w' e ,,p' e ,) e > eE > 
where w' e , : K — > K and p' e , : K — > [0, 1] both uniformly continuous 
for all e' G E' and c : E — > E' be given by w' c , Ak iM = w e |/<-., and 
w 'c(e)\ K i(c) = w e\Ki(B) f° r a ^ e € E. Then, by the continuity of Vr, for each 
e e E, d Pe = p e ljt iW \jf iW = 1 K He) \K iie) P' c (e) and *>'\R iW = w 'c{e)\K^ y Note 
that, by Lemma[5J J2 e eE i(e)=j ®P e ~ ^R \k f° r a ^ J G N. Therefore, as in the 
proof of Theorem [3] (ii), 



fdF(A) 

= J2 [ d P e ° FlT ^) f°™e° FdA 

= E hK^\K^o Fp' c{e) o Fl T ^f o W ' c{e) o FdK 

eeE J 

= E E [p'e'°Ffow' e ,oFl kiieMiie) oFl Ti(e) dA 

e'S-E' e££,c(e)=e' 

= E E E [p' e ,oFfow' e ,oFdp eo oFl Ti(ea) dA 

e'S-E' eS-E,c(e)=e' e S-E,i(e )=i(e) 

= E E E fp' el oFfo W ' el oFi l[eo] dk 

e'S-E' eS-E,c(e)=e' e e_B,i(e )=i(e) 
- E Pe' oF f° W 'e> ° ^A 



e'GB' 

UfdF{A). 

Hence, J fdF(A) < J fdU*F(A). Since / was arbitrary, the assertion follows 
by Theorem [3] (i). □ 

3.3 Contractive uniformly continuous Markov system 

In this subsection, we are going to apply the theory developed so far to the case 
when A4 is contractive. 

Now, set 

L(x) := y d(x,Xj) IkAx) for all x € K , 
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b := sup sup V" p e (x)d(w e (Xi( e )),x t ( e )) , (14) 

i£N x£Ki _ ... . 

C(x) := L(x) H for all x e Jf, 

1 — a 

where < a < 1 is a contraction rate of the Markov system, and let's abbreviate 

X m {a) := w ao o ... ow a - m (x i ( (7m )) for all a 6 S. 

Lemma 9 Suppose Ai is contractive with a contraction rate < a < 1. 

(i) UL<aL + b. 

(ii) 

U n L < a n L + for all n > 0. (15) 

1 — a 

(Hi) For every x £ K , m < and n > 0, 

^ d(X m ( f r), W(To o...o^ m _(x))dF™-™(a)<a- m + 1 C(x) (16) 

and 

Jd(X m ,X m ^)dP^- n < a- m+1 2C(x). (17) 

Proof, (i) Let x £ Ki for some i £ N. Then 
!7X(x) = y^p e (x) y^ d(w e (x),Xj) l Ki (w e x) 

eeE j£N 

- X! Pe(x)d(w e (x),W e (Xi)) + ^ Pe{x)d{w e {Xi),X t (e)) 

e£E, i{e)—i e£E, i(e)—i 

< aL(x) + b. 

(ii) (p~5|) follows immediately from (i). 

(iii) Clearly, the inequality is true if b = oo. Now. suppose b < oo. By the 
contraction condition and (1151). 



d(X m (a),w (To o ...o W<Tm o ... °w CTm _ n (x))dP™ ™(cr) 

< a~" l+1 2_, Pe m - n ( x )—Pem-i( w em-2 ° ••• ° w e,„_„x) 

e m _„ r ..,e m _i£E 

xd(x t(em _ l) ,w; em _ 1 O ... otc em _Ji)) 
- a- m+1 C/ n -M ^ Pem _ 1 d(x t{em _ l) ,w e _ 1 )\(x) 

\e m _i£B / 

< a- m+1 (6 + af7 n - 1 i(x)) 

< a-" l+1 C(x). 

This proves (fTS]), and (fTT)) follows by the triangle inequality. □ 
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Lemma 10 Suppose Ai is contractive with a contraction rate < a < 1. Then 

/i 
Ldn< for allu€P(M). 
I- a 

Proof. Let /i G P(A4). Clearly, the inequality is true if b = oo. Now, suppose 
b < oo. For / <E C B (K) and fc G N, set / A k := min{/, k}. Observe that 
U(fAk) < kAU(f). Hence, by induction, U n (fAk) < k A U n (f) for all n G N. 
Therefore, by (|T5|) , 

LAkd/j,= J U n {LAk)dn< I kh (a n L+- J d/i 

for all n G N. Thus, applying Monotone Convergence Theorem two times implies 
the assertion. □ 

3.3.1 Main theorem 

Condition 2 There exists xq G K such that the sequence of probability mea- 
sures (a n ) n eN on N given by a n ({j}) := l/n^ =1 U* 6 Xo (Kj) for all j G N 
and n G N is uniformly tight. 

Theorem 5 Suppose M. is contractive with a contraction rate < a < 1 and 

uniformly continuous, and 6 < oo . Then the following holds true. 

(i) E(M) is not empty if M. has a dominating Markov chain, and Condition^ 

is satisfied. 

(ii) E{M) C ®(P(M)) C E(M) and F($(/i)) = fi for all /i G P(M). 

(Hi) There exists a sequence of Borel sets Q\ C Q2 C ... C Sg with X)fc>n < ^ > (/ i )(^\ 

Qk) < 1/(1 - \ r a)a n / 2 for all \i G P(M) and n G N such that for each k G N 

d(F(a),F(a')) < §- -d'(a,a')™ 

(1- vo)(l-a) 

whenever a, a' G Qk with d'(o~,o~') < (l/2) fc+1 , i.e. F\q k is locally Holder- 
continuous with the same Holder-constants for all k G N. 



Proof. Set 

n 
fe=l 

for all m G Z and n > 1 where a^o is given by Condition [5J Then each </>^ is 
clearly a measure on *4 m . Recall that E + is a compact metrizable space. Clearly, 
the set of all pre-images of cylinder sets in B(E + ) under 7r is exactly the set of 
all cylinder sets in Ai- Therefore, since both c-algebras are generated by their 
cylinder sets, 7r _1 (6(E + )) = Ai, i.e. the induced set map 7r _1 : B(E + ) — > A\ 
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is bijective. Since the set of all Borel probability measures on S + is sequentially 
compact in the weakly-star topology, there exists a subsequence (7r((/>™ fc ))fc 6 N 
and a probability measure (j> + on B(Y, + ) such that 7r((/>" fc ) converges to <f> + 
weakly-star as k — > oo. Observe that, by the definition of </>™'s, 4> + is invariant 
with respect to the left shift map on X + , as the shift maps commute with it. 
Set 

M(tt -1 (B)) := (f> + (B) for all B G B(2 + ). 

Then this defines a shift-invariant measure M on A\. Furthermore, by the 
shift-invariance of M, this gives consistent measures on A m for all m G Z, by 
M(S m ~ 1 A), which we will also denote by M. In particular, M defines consistent 
measures on all finite dimensional sub-er-algebras of the product cr-algebra on 
S. Let ei, ...,e n G 2?. Observe that the image of i[ei, ...,e„] C 2 under -k is a 
cylinder set which is open and closed in S + . Observe that </>" = <fi™ o S" 1 ^ 1 for 
all m < 1 and n > 1. Therefore, 

lim ^™ fc ( m [ei,...,e„]) = lim 0™ fc (i[ei, ..., e„]) 
= lim </)™ fc o7T _1 (7r(i[ei,...,e„])) = + (7r(i[ei,...,e„])) 
= M( m [ei,...,e n ]) (18) 

for all ?n < 1. Furthermore, observe that 



liminfC=(C)>M(0) (19) 

k— >oo 



for every open set O G .4 m and m < — 1, as ir is open. 
Now, for every m < and a finite C C E, 



P 



m—k 




= Y, S lPe°w am _ 1 o...ow (rm _ k (xo)PZ k (a) 

jGN eGE\C,i(e)=j 

< J2 Yl sup p e (a;) / 1 



j£N e£E\C,i(e)=j' 

K, O W am _ % O ... O U 7 CTro _ fc (x )P™- fe ( ( T) 



j£JV e£E\C,i(e)=j ' 

= Y Y sup p e (x)U* k 6 X0 (Kj). 

jGN e£E\C,i(e)=j XGKj 

By the hypothesis, there exists a finite V € C N such that a n (N \ V e ) < e/(2£) 

25 



for all n G N, where £ is in Definition [S] Thus, by (TIT)]) , as UeeMC m M ^ s °P en , 
MJ (J ro [e]J < limmfC fc ( IJ ™l e| 

\eGB\C / V \ee_B\C 

< limsup^] ^2 sup p e (x)a nk ({j}) 

k ^°° jeN eeE\C,i{e)=j X£Kl 



< Yl Yl sup Pe ^ + 2 

j£V t e£E\C,i(e)=j xeKj 



Therefore, there exists a finite C C E such that 

(20) 





This means that each one-dimensional measure M has an approximating com- 
pact class. Therefore, M extends uniquely to a shift-invariant Borel probability 
measure on E, which we will also denote by M, e.g. by Kolmogorov Consistency 
Theorem [3] . (As E is a Polish space, the existence of a compact approximating 
class is actually automatic. However. (j2"0)) is still needed for the next step.) 

Now, set 

f^oo : = {°~ £ £| there exists m G Z s.t. er m = oo} . 

By (f2"0")) , for every ra€Z there exists a finite C m C -E such that 



< -2-H, 



As fioo C UmezUee-E\c m ™[ e L ^ follows that M(Sloo) < 3/4e < e. Since e was 
arbitrary, we conclude that 

M(fi oo )=0. (21) 

Next, we show that Eg has the full measure. First, observe that every a G £\£ G 
is either in 0^, or there exists ei, ..., e n G -B such that (ei, ..., e„) is not a path 
and cr G m [ei, ...,e n ] for some meZ. By Remark[T]and (fT5|) . M( m [ei, ...,e n ]) = 
0. Hence, for every cr G S \ (SIqo U £ G ) there exists an open set O ct such that 
<t G Ocr and M(O a ) = 0. Choose open sets Ooo C E and G c E such that 
f^oo C Ooo, E G C G , M{Ooo) < e/2 and M(0 G \ E G ) < e/2. Then, by the 
compactness of E, there exist finitely many a 1 ,..., a G E \ (Sloo U E G ) such 
that E = G U Ooo U UiLiO^.. Hence, M(O g U Ooo) = 1, and therefore, 
M(E G ) > 1 — e. Since e was arbitrary, we conclude that 

M(E G ) = 1. (22) 
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Now, we are going to show that M(D) = 1. For x £ K and m < 0, set 

A™~ 1 := {a e S| (((^(a),^.!^) > a^ ±i 2C(x)} . 
Then, by (IJJ, 

for all £ € -ftT, m < and n > 1. Hence 

C «) < ^ (23) 

for all m < -1 and n > 1. Therefore, by dHJ and dH]), as A™ 

^ U e e gB m[e mj •■•, eo] is a countable union of some open cylinder sets, 

M (A™ ) = M (A™ \ Q x ) < lim inf tf* I A™ n M m [e m , ..., e ] ) < a^ 

\ e m ,...,e G£ / 

for all m < — 1. 

Now, set 

4*0 := n U A 

Then 



!C0 

K-lm<I 



M (A Xo ) < J] M (A™) < ^ a^ for all Z < -1. 

m<l m<l 

Hence 

M(A xo ) = 0. 

Now, observer that for every a G £g \ A Xo , sequence (X m (a)) m <o is Cauchy 
Hence, by the completeness of (K, d), Hq \ A XQ C Z?. Therefore, 

M(D) = l. (24) 

Now, we are going to compute EmO-^I^) f° r au e E E. Fix e E E. First, 
observe that, for x E K, m < 0, n > and m [e m , ..., eo] C S, 

l l[e ]dP,, 

m [e m ,...,eo] 

/ y ^x \m— n [^m— n? •■•: e m _i , e m , ..., eo, CJ J 

e m _„,...,e m _i£_E 

C/™(P m ( m [e m ,...,e ])p e o w eo o ...o-m em )(x) 

Pe o Wcto o ... o w <Tm (y)dP^(a)dU* n S x (y) 

• m ,...,e ] 

p e o X m (a)dP™- n (a) + r mrhX ( m [e m , ..., e ]) (25) 
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where r mn ^ x is a signed measure on J- m given by 



r mn ,x{A):= I I (p e oto,, o ... o w„ m {y) - p e o X m (a)) dP™(a)dU* 5 x (y) 

A 

for all A £ T m . Hence, as every member of T m can be written as a countable 
disjoint union of cylinder sets, 

/ K[e}d4>m = / Pe ° X m d(ff n + - ^2 r m k.xo (A) 

A A k=1 

for all A £ T m and m < and n £ N. This implies, by ((THJ) and ([2l]). that 

/ l l[e] dAf = / p e o X m dM + lim — V r mk , Xo (A) (26) 

J J fe^oo n k f— 



fc=i 



for all ^4 which are finite unions of cylinder sets from J- m and m < 0. Now, for 
y £ K and m < 0, set 

B m ,y ■■= \cr £ S| d(uv o ... o u! CTm (y),X m (cr)) > a^5— (7(^)1 

and 

/9 e (t) : = sup {p e (a;) ~Pe(y)} for all t > 0. 



Then, by (JT! 

■P™ (-B m , y ) < a^^ 1 for all y £ K and to < 0. 
Therefore, 

|r mfejX0 (A)| < a^ 1 + J ^(a^Ciy^dU^S^y) (27) 

for all A G J* m , to < and k £ N. Set p := 6/(1 - a) + i(x ) and 

B(a)~ f) (K\if 3 )UB a ( Ij ) 
jew 



for all a > 0. Then, by {H}, 
P > f/ fc i(x ) 

= / ^2 d (w ak o ...o w ai (x ),x j )l Kj ow ak o ...ow ai (x )dP XQ (a) 

J JEN 

> — y^Pi n ( d(«v fc o ... o w CTl (xq),Xj) > — and W ak o ... o to^ (a; ) £ Kj 

JEN ^ 

> ^Pl > [w ak o...ow ai (x )£K\B(^j^ 
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for all k > 1. Hence 



Pl (w„ k o ... o w ai (x ) EK\B f^-Vj < | for all k > 1. 



Thus 



r^,„(K\u(*e. 



L K \ B (a£) o w IJk o ... o Wai (x )dP^ (a) 



P}„ [<>:., :■-.. :■«',.,(,'■") = ^^(7 



e 
< - 

~ 2 



for all jfe G N. Now, set C £ := 2p/e + b/(l - a). Then C(y) < C* e for all 
y G B{2p/e). Therefore, by (|2Tj) . 

|r m fc )a!0 (A)| < a^ 1 +/? e (a^^Ce 



for all A E J 7 ™, to < and & G N. Thus, by dm 



l l[e] dM- / Pe oX m dM 

A A 



< 



-m+1 _ / -m+l \ e 

a 2 +ft(o ! C f j+- 



for all ^4 which are finite unions of cylinder sets from J- m and m < 0, and, since 
every member of J- m can be written as a countable union of cylinder sets, by 
Lebesgue's Dominated Convergence Theorem, it holds true for all A E T m and 
to < 0. That is 



/ (E M (l l[e j \F m ) ~p e o X m ) dM 



< 



-m + l n ( -m + l \ £ 



for all A E T m and to < 0. Set A m := {<r E Z\ E (l l[e] |.F m ) (ct) < p e o X m (a)}. 
Then 



(^/(^[ejl^mj-PeO^mldA^^a^ 2 ^ +,3 e (a^ ±i C e ) + 



and, obviously, the same inequality holds true also with E \ A m in place of A m 
for all to < 0. Hence 

\E M (l l[e] |^ m ) - Pe o X m \dM < 2a^ il + 2/3 e (a^C^) + e (28) 

for all to < 0. Let a E D. Observe that X m (a) E Kt( aQ ) for ah to < 0. 
Therefore, lim TO _ > ._ 00 p e o X m (a) = p e o F(a) if i(e) = t(ao). Otherwise, 
lim m _j._ 00 p e o X m (a) = 0. Hence, since M(D) = 1, 

lim p e o X m (a) =p e ° F(cr)l Ki{c) (x t(cro )) for Af-a.a. a E E. 



771— J- — OO 
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Therefore, by Lebesgue's Dominated Convergence Theorem, p e o X m (a) con- 
verges to p e o F(a)ljf, w ( x t(a )) m £ 1 (M). Therefore, by the triangle inequality 
and P5j). as -Em (l^e] !•?>«) also converges to Em (l 1 [ e ] |^-*) in £ 1 (M), 



\E M (l l[e ]|-^) (c7)-p e oF(a)lK i(e , (x t(CTo) )|dM(c7) < e. 

Since e was arbitrary, we conclude that 

% { 1 m\^F) W) =Pe° F(a)l K . (e) (xt(o-o)) for Af-a-a. cr e £ 

for all e€£. Thus M £ E(M). This completes the proof of (i). 

(ii) Inclusion E(M) C $(P(.M)) follows from Lemma[5](i) and Proposition [TJ 

Now, we show that $(P(M)) C E(M). Set G m := {<r e £| (<r m , ...,cx| m |) is a path} 
for all m < 0. Then, by Remark Q] $(/i)(G m ) = 1 for all m < 0. As 
Eg = rim<o G m and G m _i C G m for all m < 0, it follows that 

*0*)(Eg) = 1. (29) 

The integration of (| 1T[) with respect to fi implies that 

d(X m ,X m _ 1 )d^(n) < a- m+1 2 fc(x)n(x) 

for all m < 0. By Lemma [TU1 J C(x)p,(x) < 26/(1 — a), therefore we can define 

An-i := {a g g| d{X m {(j),X m _ x {(r)) > a^ ±i 2Gi} 
with d := 26/(1 - a) for all m < 0. Then 

$(/*) (An) < a^ (30) 

for all m < — 1, and the same way as for (|24|) . this implies that 

*(/i)(X>) = 1. 
Now, let e € E. The integration of (fS3|) with respect to /i gives 

l 1 [ e ]d$(/i) = / p e oX m d$(n) + r m ( m [e m , ...,e ]) (31) 



m [e m ,...,e J m [e m ,...,e ] 

for all m [e m , ..., e ] € J 7 ™ where r m is given by 

r m (A) ■= {Pe o w ao o ... o w am (y) -p e ° X m (a)) dP™ -(a)dfi(y) . 

A 

for all A £ T m . Furthermore, the integration of (JTHJ) gives 

d(w ao o ...ow am (y),X m (cr))dP™(a)dn(y) < a - m+l C v (32) 
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for all m < 0. Hence, the same way as for (f!ZT|) . it follows that 

|r m (A)| < a = ^+0 e (a =s ^C 1 ) (33) 

for all A E F m . Therefore, as in the proof of (i), (fcTf]) implies that 
E*Qj.) (li[e] I- 77 ) = Pe o ^lT 4(e) $(/x)-a.e. 

for all e e E. Thus <&(/x) G -E(Al), as desired. 

Next, we show that F(§(fi)) — /i. It is sufficient to show that the measures 
agree on all bounded uniformly continuous non-negative functions on K (as this 
set of functions is closed under multiplication and generates Borel a- algebra). 
Let / e C B (K) be bounded and uniformly continuous. Observe that, for each 
m < 0, 



fd» = J U- m+1 (fW 

= f°w ao o...o w am (x)dP r x n (a)dfi(x) 

= J f o X m d^(fi) + R m (34) 

where 

Rm-= I I (/ o w aa o ... o W(Jm {y) - f o X m (a)) dP^(a)d^(y). 



Since / is uniformly continuous and bounded, one sees, by the contraction con- 
dition, the same way as for (|3"3")h that \R m \ — > as to — > — oo. Therefore, since 
$(/i)(-D) = 1, by the already shown, (|3"4")) implies by Lebesgue's Dominated 
Convergence Theorem that 

J fdfi=ffo Fd^(ti) = J /dF(*(/*)), 

as desired. 

(hi) Now, set 

Q k ■- p| E \ A m 

?71 < — k 

for all fc e N. By gJJ, £ fc >„ $(/*)(£ \Q fc ) < 1/(1 - ^)a"/ 2 for all M € P(M) 
and neN. Since $(/i)(D) = 1 for all /j, € P(A^), we can assume Q^ C -D for 
all fc. The proof that F|Q fc is locally Holder continuous is the same as that of 
Lemma 3 (hi) in [14] • We give it for completeness here. Let a, a' 6 Qi for some 
I G N. Then, by the triangle inequality, 

d(X m (<j),X m - k (<j)) < Va^ ti 2C*i =2Ci ^a^ 1 for all to < -J, fc > 1. 

rr^ 1 - v a 
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Hence 

d(X m (a),F(a)) < 2C\ — = a^r 1 for all m < -I. 

1 - V a 
The same way, 

d(X m (a'),F(a')) < 2C*i —= a^r 1 for all m < -Z. 

1 - V a 

Now, let d'(a,a') = (l/2)-" l+1 for some m < -I. Then X m (u') = X m (a). 
Therefore, 

d(F(a),F(aO) < ^= a^ = 7^— ^ r d'(a, o>f**Wm 

1 - V a (i-v^il 1 - ) 

This completes the proof of the theorem. □ 

Corollary 1 Suppose M. is contractive, uniformly continuous and non- degenerate 

such that b < oo. Then the following holds true. 

(i) Suppose A4 has a dominating Markov chain. Then E(A4) is not empty if 

and only if Condition [H is satisfied. 

(ii) $ is the inverse of F : E(A4) — > P(A4). (Thus, the latter does not depend 

on the choice of Xi € Ki for all i G N as long b remains finite.) 

Proof, (i) The 'only if part follows from Lemma [21 iv). The 'if part follows 
from Theorem [5] (i) and Theorem [5J 

(ii) The assertion follows by Theorem [S](iii), Theorem [5] and Lemma [5] (i). □ 



3.3.2 Invariant measures 

Obviously, any Borel probability measure on 1Jj GS i*Q can be uniquely identified 
with a member of P{{j ie g Ki). The following simple proposition enables one to 
reduce the problem of determining whether a Markov systems has an invariant 
measure to that on a subsystem, which might be easier. 

Definition 6 We say that A4 has a Markov subsystem iff there exists S C N 
such that (ifi( e ), ii' e ,p e ) e gj-i(5) is a Markov system on {J it , s Ki. 

Proposition 2 Suppose M has a Markov subsystem (K i ^,w e ,p e ) e€i -i^s); f or 
some S C N, which has an invariant fi G -P(Uigs-^i)- Then /z G P(M). 

Proof. Let B C K be Borel. Then 

U*^(B) = /^p e l fl O(U e dfl= / ^2 Pe^Bn U Ki ° Wedn 

ies 



Bn\jKi) =n(B). 

k i&S J 
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□ 

Corollary 2 Suppose A4 is contractive and uniformly continuous such that 
b < oo. Then the following holds true. 

(i) Suppose Ai is non- degenerate and has a dominating Markov chain. Then 
P{M) is not empty if and only if Condition® is satisfied. 

(ii) Suppose M is consistent, has a dominating Markov chain and satisfies Con- 
dition® Then P(A4) is not empty. 
(Hi) P(AA) is uniformly tight. 

Proof, (i) The assertion follows by Corollary Q] and Proposition [T] 

(ii) The assertion follows by Theorem [3] (i) . 

(hi) Let e > 0. By Theorem [3] (hi), there exists a Borel set Q C S with 
Q C E G such that $(/z)(Q) > 1 - e for all [i G P(M) and F\q is uniformly 
continuous with respect to d! . Let Q denote the closure of Q in E and Q denote 
the closure of Q in (Sc,d'). Let C C £ be closed such that Q C C. Hence 
Eg \(Cfl Eg) = Eg n (E \ C) is open in the induced topology on Eg- That is 
C n Eg is closed in the induced topology. Since d! generates exactly the induced 
topology on Eg, we conclude that Q C C C\ Eg, and therefore, Q C Q. Since Q 
is compact, Q D Eg is compact in the induced topology. Since QcQfl Eg, Q 
is compact in the topology generated by d! . 

Now, let F be the continuous extension of F\q on Q. Set C := F(Q). Then C 
is compact and by Theorem [S] (hi), 

Ii (d) = $( M ) (V 1 (5)) > $( M ) (F- 1 (f(Q))) > $(M) (Q) > 1 - e 

for all /i G P(Ai). This completes the proof. □ 

Corollary 3 Suppose M is contractive and uniformly continuous such that b < 
oo. Then P(M) is not empty if M. is consistent and has a dominating Markov 
chain such that c < oo. 

Proof. By the hypothesis, there exists £ > such that (fT!Z)) is satisfied. Let 
k > 0. Then for every x € K and j E N, 



U* h 6*{Ki) 




]T P- fc U.[e_ fc ,..,e_ 2 ]) 

e_ fc ,...,e_ 2 e.E 
eGE,t(e)=j 




< 


J2 P- k (-k{e- k ,..,e_ 2 }) 

e_ fc ,...,e_ 2 e-E 

x ^2 sup p e (x) 




< 


? sup q^ 
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where (lij)i.jeN is the transition matrix of the dominating Markov chain. Fix 
xq € K and, for each n€ff, set 



1 - 
a n ({j}):=-Y,U* k S X0 (K j ) 

fc=i 

for all j G iV. Then 

a n ({j}) < £supgy 

for all j & N and n G N. Let e > 0. By the hypothesis, there exists a finite 
V e C N such that X)jejv\v" e su Pjeiv Qij < e /£- Then o n (7V\V r e ) < e for all n G N. 
Thus, the assertion follow by Corollary [5] (ii) . D 

Condition 3 Suppose Q is either empty or of the form U ie g K% for some S C 
N such that[J i€S Ki is closed and {K i i e \ 1 w e ,p e ) e ^ i -iig\ is a consistent Markov 
subsystem. 

Corollary 4 Suppose M is contractive such that b < oo ; uniformly continuous, 
has a dominating Markov chain such that c < oo and satisfies Condition^ Then 
P{M) is not empty. 

Proof. If O is empty, then, by Lemma [51 Ai is non-degenerate, and therefore, 
the assertion follows by Corollary [3] 

Now, suppose tt is not empty. Then, by the hypothesis, there exists a Markov 
subsystem on a complete metric space which, by Corollary [3J has an invariant 
measure. Therefore, by Proposition [51 P(Ai) is not empty. □ 



4 Examples and applications 

In this section, in particular, some simple examples are given to which the 
previous theory apparently could not be applied. 

Example 1 This is to demonstrate that Proposition [I] Corollary Q] and Theo- 
rem [T] cover Theorem 2.1 in [11| . 

Let G :— (V,E,i,t) be a finite directed graph. Set Eg := {(..., ct_i, ao)\ a m G 
E and t{a m ) — i{a m -i) for all to G Z \ N} (be the one-sided subshift of finite 
type associated with G) endowed with the metric d(<r,cr') := 2 k where k is the 
smallest integer with Cj = o' i for all k < i < 0. Let T : E^ — > Eq be the right 
shift map given by (Tcr)j = o~i-\ for all i < 0. Let g be a positive continuous 
function on E^, such that 

X] d{v) = 1 for all x € S G - 

yeT-i(M) 
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Set Ki := {cr € E G : £(<xo) = «} for every i £ V and, for every e £ E, 

w e (a) := (...,a-_i,(Jo,e), _p e (c) := #(..., cr_i,cr , e) for all a £ #j( e ). 

Obviously, maps (w e \K iM )eeE are contractions with a contraction rate a = 1/2. 
Therefore, .M s := (l"Q( e ), w e ,p e ) pF defines a uniformly continuous contrac- 
tive Markov system. Since each i£j is open, A4 g is non-degenerate (i?l = 0). 
Therefore, by Corollary [2] (i), it has an invariant Borel probability measure. An 
invariant probability measure of M. g is called a g-measure [?]• Let U g be the 
Markov operator associated with Ai g . Then, for every / G C B (Eg), 

U g f(x) = J2 9(y)f(y) for all x £ E G . 

yeT-i({x}) 

Observe that, in this case, F is nothing else but the natural projection Eg — > 
T,q and $ is the natural extension of a shift invariant measure. Moreover, in 
this example, statements (ii) and (iii) of Theorem [S] and Corollary [5] (iii) are 
obvious, Theorem [5] (iii) can be strengthened to globally Holder continuous F 
and Proposition [TJ Corollary[T](ii) and Theorem Q] reduce to Theorem 2.1 in [11] 
as follows. Let B denote the Borel cr-algebra on E G , P(E G ) denote the set of all 
Borel probability measures on E G and Pt(E g ) denote the set of all T-invariant 
members of P(E^). 

Theorem 6 (Ledrappier, 1974 |11| ) Let m £ P(E G ). Then the following 

are equivalent: 

(i) U g *m = m, 

(ii) m £ Pr(E G ) and E m (f\T~ 1 B) = J2 z eT-i{Tx} 9( z )f( z ) m-a.e. for all 

f£C 1 (m), 

(Hi) m £ Pr(E G ) and m is an equilibrium state for logg. 

Proof. Let U g *m — m. Then, by Corollary [1] (ii) , $(m) £ E{M g ), i.e. $(m) is 
5*-invariant and 

■E*( m ) (l^e] I J 7 ) =Pe°F $(m)-a.e. 

for all e £ E. Hence, m is T-invariant, as F o 5 = T o F. Let A <G T~ 1 B and 
e £ E. Let o[e]~ denote the cylinder set in E G . Then 



l o[e ]-dm 



/ l [ e] d*(m)= / l l[e] d*(m) 

^ F-»(A) F-!(T(A)) 

/ p e o Fd$(m) = / p e dm= / J^ g(cr)l o[e] - (cr)drn(a;) 

F~!(T(A)) T(A) T(A) "^^'W 

= j52 9(o-)\[ e )-(cr)dm(x). (35) 



CT gT- 1 {Tx} 
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Hence, for any other cylinder set fc[efc, ..., eo] CS 



G- 



± k [e k ,...,e ]-dm = J l [e„]-dm 

ADfc[efc,...,e_i]- 



\ aeT-i{Tx} 

By linearity, we obtain 



/ Yl 5'(c r )l [ eo ]-(cr)dm(x) 

,..,e_i]- -ST-HT.} 

/ XI SW 1 *^, ..,e ]-(<r)dm(x). 



An k [e k ,..-,e-i]- 



/ sd?n = / \ g(a)s(a)dm(3 



for any simple function s G C l (m). Since the simple functions are dense in 
£ 1 (m), we conclude 

E m (f\T- 1 B)= J2 9(z)f(z) m-a.e. for all / e ^(m). 

«£T- 1 {Tx} 

This show the implication from (i) to (ii). 

Form (ii) and (J33)) , we obtain 

■E*(m) (li[e] 1^") =Pe°F $(m)-a.e. 

for all e £ E. Therefore, $(m) e E(M. g ). Hence, by Theorem [TJ $(m) is an 
equilibrium state for u. Observe that h m (T) = h<f>t m )(S), since $(m) is the 
natural extension of m. Therefore, 

h m (T) = / ud<S>(m) = / \ogp ai o F{a)d<5>{m){a) = \ \oggdm. (36) 



Thus m is an equilibrium state for logg. This proves the implication from (ii) 
to (iii). 

Finally, by (f3"6"]> . $(m) G £'(«) if wi is an equilibrium state for logg. Hence, by 
Theorem Q] and Proposition [TJ U g *m = m. This completes the proof. □ 

Example 2 Consider the following random dynamical system Dr := ((R, |.|), w n ,p n ) n >z 
where 

1 1 



».', 



t (x) := Z \J\og2\f\ognx + 1 and p„(x) 



Z n(log n) 2 

for all x € R and n > 3 where Z is the suitable normalizing factor such that 
^2 n>3 p n — 1- Then a simple computation shows that 

oo 

z ^Pn\w n (x)-w n (y)\ < y/iog2 / — — -^dt\x-y\ = -|x-y| 



n>3 
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for all x, y € K, i.e. Dr is contractive with a contraction rate 1/2. Also, for any 
choice of x$ <G R, 



^p n |w„(x ) - x \ < -x + |1 - ar |. 



6 = 

n>3 

It is, obviously, non-degenerate. Thus by Corollary^ (i) and Corollary[TJ Dr has 
a unique invariant Borel probability measure /i. However, one easily checks that 
the Bernoulli measure <&(^) has infinite entropy, i.e. {M g E(M)\ hs{M) < 00} 
is empty. 

Example 3 Consider the random dynamical system ([0, 1], u> e ,p e ) ee { ,i} where 

. . 1 11 

w o(x) ■= 2 X ' w i x := 2 + 2 X ' 

p (x) := x, pi{x) :=l-x 

for all x G [0, 1]. The following Markov partition makes the random dynamical 
system to a uniformly continuous Markov system with strictly positive proba- 
bility functions. Set K x := {0}, K 2 := (0, 1), K 3 := {1}, 

w a ■= wi\ Kl ,w b := w \ K2 ,w c := wi\ K2 ,w d := w \k 3 

Pa ■=Pl\K 11 Pb :=Po\k 2 ,Pc --pi\K 2 ,Wd ~Po\K 3 , 

and i : {a,b,c,d} — ► {1,2,3} by i(a) := 1, i(b) := 2, j(c) := 2, j(<2) := 3. 
Obviously, Rl = l{o}u{i} an d 

R 2 l= ^2 dPe±{o}u{i}°We=0. 

e£{a,b,c,d} 

Therefore, by Lemma [Bl Markov system (K^, w e ,p e ) e£ i abc( n satisfies the 
conditions of Corollary [2] (i). One can choose also an infinite Markov partition, 
e.g. Kx := {0}, K := {1}, K t := (1 - 1/2 1 " 2 , 1 - 1/2'- 1 ] for all i > 2. Then 
one easily sees (by drawing the directed graph of the Markov system) that 

R1 = 1 {o} + ifi-i} + !{i-i} + •••! 

2 111 

R 1 = 1 m + o l {i-h) + i l v-\} + s 1 !!-!} + - 



and 



rfi 1- 1- 1 



Since i? 3 l < 1, by Lemma [6l the resulting Markov system is non-degenerate, 
and therefore, also satisfies the conditions of Corollary [2] (i) for any choice of 
Xi € Ki for all i € N. (Note that the dominating Markov chain has a positively 
recurrent class.) 
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Example 4 Consider the random dynamical system ([0, 1], u>e)Pe)ee{o,i} where 
wq and w% as in Example [3l but 

p (x) := 1 -x, £i(x) := a; 

for all x G [0,1]. The random dynamical system has a following equivalent 
proper Markov system M := (i^( e ), w e ,p e ) ee {a.f,, c ,d} where ^ := {0}, # 2 := 
(0,1), K 3 :=l, 

w a ■= w a \ Kl ,w b := w \k 2 ,w c := wi|x 2 ,Wd := Wi\k 3 
Pa ■=Po\K 1 ,Pb :=Po\k 2 ,Pc ■■=Pi\K 2 ,Wd -=Pi\k 3 , 

and i : {a, 6, c, d} — > {1, 2, 3} by i(a) := 1, i(6) := 2, i(c) := 2, i(d) := 3. If one 
draws the directed graph associated with the Markov system, one can see that 
(Ku e \,p e , to e ) e gj-i({i 3j) forms a Markov subsystem which has more than one 
invariant probability measures. Thus, by Proposition (5J the Markov system also 
has more then one invariant probability measure. Moreover, note that dp a = 0, 
dpb = l{o} > dp c = 1{!} and dp d = 0. Hence, 

■Rl = !{o}u{i}- 

Therefore, the Markov system satisfies the conditions of Corollary 2) Further- 
more, R(Rl) = Rl, and therefore Q, = {0} U {1}. Set a° := (...,6,6,6, ...). 
Then, obviously, cr° G T 2 , but F(cr°) = 0, and therefore a G F^i^i). Hence 
cr° ^ G. Set A := ^o. Then, by Lamma EH A ^ E(M), but, obviously, 
F(A) = S e P(M). Let A € J 7 , then 



/ l l[6] dA = A(A) = [ l Kl o Fl T2 dA = f d Pb o Fl 



T l(b) dA. 



Hence, A G £'j_(A1). Thus, by Theorem [51 M. is degenerate. However, by 
Theorem 21 it is consistent. Also, it can be seen by Theorem [3] (ii), as ob- 
viously, Iq-R/ = InUf for all / S £ B (K), or by Lemma [71 (Interestingly, 
A(F- 1 (F(G)))>A( J F- 1 ({0})) = 1.) 

This example also can be used, in order to see that the Condition [T] is not 
necessary for the consistency of a Markov system. Set K' :— {0}, K[ := {1}, 
K' 2 ■= Ui>2, euen (l ~ l/2 l - 2 ,l - 1/2*- 1 ] and K> 3 := Ui>8 l0 *l(l - l/^M - 
1/2 2-1 ]. Then, the restrictions of the maps and probability functions form 
a finite uniformly continuous Markov system. In this case, also 1 G fi, but, 
obviously, #1(1) = 2 > 171(1), as K 2 \ K 2 H K' 3 \ K' 3 = {1}. 

Example 5 Let Blim be a Banach limit. Consider the following random dy- 
namical system (K, w e ,Pe) e e{o.i} where K := {{x\, x 2 , ...)| Xj € [0, 1] for all i G 
N} equipped with the supremum norm and 

W (x):=-X, Wl (x) :=(-,-,... j +-x, 

p (x) := Blim(x), pi(x) := I - p (x) 
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for all x E K. Recall that space (iif, ||>||oo) is n °t separable. Since Blim is 
continuous, it is Borel measurable. Set K\ := {x € K\ Blim(x) = 0}, K% := 
{x E K\ Blim(x) = 1} and K<z := K\ (K\ n K3). Then the random dynamical 
system is equivalent to the following Markov system. Set 

w a ■= wi\ Kl ,w b := w \ K2 ,w c := wi\ K2 ,w d := w \k 3 
Pa := ■p\\K 11 Vb :=Po\k 2 ,Pc \=px\K 2 ,Wd :=Po|jf 3) 

and i : {a, b,c, d} — > 1,2,3 by i(a) :— 1, i(b) :— 2, i(c) :— 2, i(d) := 3. By the 
continuity of Blim, K\ and K2 are closed and K2 = K. Hence Rl = 1k x uK 2 
and R 2 1 = 0. Therefore, by Lemma[Sl Markov system (-Ki( e ),u> e) .Pe)ee{a,& c,d} 
satisfies the assumptions of Corollary [5] (i). 

The following example is probably the most useful one. 

Example 6 Fix n <E N and o, <E [0, 1] for all i e {0, ..., 2" - 1}. Consider the 
random dynamical system ([0, 1], w e ,p e ) eG r 1} where wq and wi as in Example 

13 

2™-l 

p (x) := ^2 a ^ l Qii x ) +02»-il{i}(a:)) 

for all a: € [0, 1], where Q, := [i/2 n , (i + l)/2") for all < i < 2" - 1, and 
px := 1 - p . Now, set JQ := Q 2 for all < i < 2 n - 1 and if 2 « := {1}- 
Then i"Q)j •••) ^2™ obviously form a Markov partition for the random dynamical 
system. 

In order to construct the Markov system associated with it, set E' := {i\ a, > 
0,0 < i < 2" - 1} and w[ := to |ic and p[ := pok* for all i e ££. Set 
w 2 » : = w o|{i}, P2" := Po|{i} an d E n := E' U 2" if a 2 n_i > 0. Otherwise, 
E Q := E' . Let E[ := {i| a, < 1,0 < i < 2™ - 1} and set w'_ t := w x \ Ki 
and p'_ i := p\\Ki for all i G E[. Set u/_ 2 » := Wi|{i}j P-2 n := Pi|{i} an d 
J5i := E[ U 2" if a 2 n_i < 1. Otherwise, E x := E[. Finally, set JS := E a U £1 
and i : £ — ► {0,...,2 n } by i(e) := \e\ for all e e E. Then {K l{e) ,w' e ,p' e ) eeE is 
clearly a contractive uniformly continuous Markov system which is equivalent 
to ([0,l],to e ,j? e ) e6 {o,i}. Obviously, 

2"-l 

»=1 
Hence, 

R n + l l=R n (Rl) 

/2»-l \ 

= J^ dp ei dp e2 ow ei dp<,„ Q w en _ x o ... ow ei I ^2 1 f <+ 1 ] 
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o w e o ... o w e 



Since for every ei,...,e„ G E except for i{e\) — and i{e\) = 2™ — 1 and 
*(ei) = 2" 



W P „ O ... O W P 



z(ei) i(ei) + l 



C ^, 



i ?: + 1 



2 n 2™ 



for some < i < 2 n — 1, and <9p e (0) = for all e £ E, and 9p e (l) = for all 
ee£ with i(e) 7^ 2" - 1, 

JT +1 1 - 6„+il {1} 

for some < b n +i < 1. If fo n +i < 1, then the Markov system is non-degenerate, 
and therefore, has an invariant measure by Lemma [6] and Corollary [2] (i). Oth- 
erwise, 

R n+2 1 = R (R n+1 l) = (1 - 02»_i)l { i } , 

and therefore, the Markov system is non-degenerate if 02»-i > and it is 
consistent otherwise. Hence, it has an invariant measure by Corollary [3] or 
Corollary |U 

Example 7 Let V r := (R, u> e ,p e ) e(E {o.i} be the random dynamical system 
where wq and w\ as in Example [31 

, . (a, x G Q 

P°W = { b , xe R\Q 

for some < a, b < 1, where Q denotes the rational numbers, and p\ = 1 — pq. 
Set K Q := Q and K x := R\ Q. Then clearly, {if , #1} is a Markov partition for 
2? r , which makes it to a uniformly continuous Markov system. For this Markov 
system, il = R. Therefore, Condition [T] is satisfied if and only if Rf < Uf for 
all / G £ B (R). However, one easily checks that Rf = (ali^ + blK )f ° w o + 
(1 — (al^j + b\K ))f ° wi for all / G £ S (M). Hence, Condition [1] is satisfied 
if and only if a — b. Clearly, in this case, the Markov system has an invariant 
measure, in the agreement with Corollary [3J 
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